MAD Loss in Pattern Recognition and RBF Learning
نویسندگان
چکیده
We consider a multi-class pattern recognition problem with linearly ordered labels and a loss function, which measures absolute deviations of decisions from true classes. In the bayesian setting the optimal decision rule is shown to be the median of a posteriori class probabilities. Then, we propose three approaches to constructing an empirical decision rule, based on a learning sequence. Our starting point is the Parzen-Rosenblatt kernel density estimator. The second and the third approach are based on radial bases functions (RBF) nets estimators of class densities.
منابع مشابه
Improving the Efficiency of Counting Defects by Learning RBF Nets with MAD Loss
The method of using a lateral histogram for evaluating the number of holes (e.g., defects) from images is known to be fast but rather inaccurate. Our aim is to propose a method of improving its performance by learning, but keeping the speed of the original method. This task is accomplished by considering a multiclass pattern recognition problem with linearly ordered labels and a loss function, ...
متن کاملApplication of Rbf for Strip Shape Recognition
Based on radial basis function neural network (RBF NN),the paper proposed a new algorithm for strip shape recognition. Compared with back propagation (BP) algorithm and improved least squares method (LSM), RBF NN shows excellent overall performance, such as learning speed, recognition precision and anti-interference capability. Copyright©2005IFAC Keyword: Strip Shape, Pattern Recognition, RBF,B...
متن کاملA Comparative Study of Gaussian Mixture Model and Radial Basis Function for Voice Recognition
A comparative study of the application of Gaussian Mixture Model (GMM) and Radial Basis Function (RBF) in biometric recognition of voice has been carried out and presented. The application of machine learning techniques to biometric authentication and recognition problems has gained a widespread acceptance. In this research, a GMM model was trained, using Expectation Maximization (EM) algorithm...
متن کاملLearning without local minima in radial basis function networks
Learning from examples plays a central role in artificial neural networks. The success of many learning schemes is not guaranteed, however, since algorithms like backpropagation may get stuck in local minima, thus providing suboptimal solutions. For feedforward networks, optimal learning can be achieved provided that certain conditions on the network and the learning environment are met. This p...
متن کاملThree learning phases for radial-basis-function networks
In this paper, learning algorithms for radial basis function (RBF) networks are discussed. Whereas multilayer perceptrons (MLP) are typically trained with backpropagation algorithms, starting the training procedure with a random initialization of the MLP's parameters, an RBF network may be trained in many different ways. We categorize these RBF training methods into one-, two-, and three-phase ...
متن کامل